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TITLE OF THE INVENTION 

METHOD AND APPARATUS TO ENHANCE DIGITAL IMAGE QUALITY 
REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the priority of Korean Patent Application Nos. 2002-49699 
and 2002-65516, filed on August 22, 2002, and October 25, 2002, respectively, in the 
Korean Intellectual Property Office, the disclosures of which are incorporated herein in their 
entireties by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0002] The present invention relates to a method and apparatus to enhance digital image 
quality, and more particularly, to a method and apparatus to enhance digital image quality by 
which a document Image obtained by scanning a document including a combination of a text 
and an image is segmented into a text area, a background area, a halftone image area, and 
a continuous tone image area and then an image quality of each of the areas is properly 
enhanced to obtain an improved image quality print. 

2. Description of the Related Art 

[0003] In general, interest in a technique to effectively express an original document using 
only black and white binary information has increased with the advancement of copying 
machines, facsimiles, or multi-function peripherals. The technique can be greatly classified 
into a dithering technique to express actual continuous brightness as pseudo brightness 
using the spatial black and white distribution of an image document and a bl-level 
segmentation technique to properiy segment a text document into a text and a background 
to easily read the text from the text document. 

[0004] However, these techniques are not effective for a document including a 
combination of a text and an image. In other words, in the bi-level segmentation technique, 
problems, such as false contours, occur in an image, and in the dithering technique, the 
pseudo brightness smoothes the edge of an image, which deteriorates the reading of a text 
portion. In order to solve these problems, a variety of studies on the enhancement of the 
image quality of a document including a text and an image are in progress. 

[0005] FIG 1 is a flowchart illustrating a conventional method of enhancing the image 
quality of a document including a combination of a text and an image, the method being 
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disclosed in U.S. Pat. No. 6,175,425, entitled "Document Imaging System for 
Autodiscrimination of Text and Images," issued to Ramin Khorram on Jan. 16, 2001. 
Referring to FIG. 1 , the method includes: receiving a multi-valued signal to represent a 
document image input from a scanner or another input device in operation 100, using a high- 
pass filter (HPF) to create a template, which defines a high contrast area in a document in 
operation 102, segmenting the document image into a text area and an image area in 
operation 104, enhancing an image in the text area by using the HPF in the text area in 
operation 106, enhancing an image in the image area by using a low-pass filer (LPF) in the 
image area in operation 108, creating an image to be printed by connecting the image in the 
text area to the image in the image area in operation 110, halftone-processing the image to 
be printed in operation 112, and printing a halftone image In operation 114. 

[0006] In the above-mentioned method, an input document image is segmented into 
blocks, and then the HPF is used in each of the blocks to classify the blocks into the text 
area containing a large number of high-band components and the image area containing a 
small number of high-band components. Thus, if two adjacent blocks belong to different 
areas, one block may be blocked from the other block. Also, a block has to be very small so 
that all pixels in the block belong to the same area. However, as the block is small, feature 
extraction using frequency components becomes difficult, which results in difficulty in 
determining a proper size of the block. 

[0007] In U.S. Pat. No. 6,078,697. entitled "Method and Apparatus for Segmenting Image 
Data into Contone, Text, and Halftone Classifications," issued to Yee Seung Ng on Jun. 20, 
2000, windows of predetermined sizes are set around ail pixels of an input document image 
and then gradients of pixels in a corresponding window are calculated. Fuzzy probabilities 
to represent the probabilities that a central pixel will belong to a text area, a halftone image 
area, or a continuous tone area are calculated using the sizes and directions of the 
calculated gradients according to Fuzzy rules. Three Fuzzy probability values are 
compared, an area having the greatest Fuzzy probability value is detennined as a class of 
the central pixel, and falsely-classified pixels are reclassified to fix (determine) a class of the 
central pixel. In this method, since the class of the central pixel is detemnined using only 
neighboring infomnation, many errors may be made. In addition, when adjacent pixels 
belong to different classes, different image quality improvement methods should be applied 
to the adjacent pixels. As a result, a final print may be unpleasant to a viewer's eyes. 

[0008] In U.S. Pat. No. 5,956,468, entitled "Document Segmentation System" and issued 
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to Hakan Ancin on Sep. 21, 1999, an input document image is converted into a low 
resolution image, wide text and image areas are found from the low resolution image, and a 
dark text area on a bright background is found from the remaining area of the low resolution 
image to perform an image quality enhancement process to enhance the readability of the 
dark text area. In this method, only the dark text area on the bright background is 
emphasized, while an image area is hardly emphasized. 

SUMMARY OF THE INVENTION 

[0009] The present invention provides a method of enhancing digital image quality of a 
document image, obtained by scanning a document including a combination of a text and an 
image classified into a text area, a background area, a halftone image area, and a 
continuous tone image area, by applying a proper image quality enhancement process to 
each of the areas to obtain an improved image quality print. 

[0010] The present invention also provides an apparatus to perform the above described 
method. 

[0011] According to an aspect of the present invention, there is provided a digital image 
quality enhancing method to improve a quality of a document image comprising pixels with a 
predetermined resolution and obtained by scanning a script comprising a combination of a 
background, a text, and an image. The method comprises: updating history information 
regarding color data and a pixel type of a concerned pixel using previous history information 
of the concerned pixel; determining a block feature type of the concerned pixel using the 
pixel type and the updated history information of the concerned pixel; detemiining a type of 
an area to which the concerned pixel belongs based on a second type of a second area to 
which a first neighboring pixel in a left direction of the concerned pixel belongs, a third type 
of a third area to which a second neighboring pixel in a line above the concerned pixel 
belongs, the pixel type of the concerned pixel, and the determined block feature type; and 
performing different image quality enhancing processes based on the determined area type. 

[0012] According to another aspect of the present invention, there is provided a digital 
image quality improving apparatus to improve a quality of a document image comprising 
pixels with a predetermined resolution and obtained by scanning a script comprising a 
combination of a background, a text, and an image. The apparatus includes a history 
infomiation updating unit, a block feature type detecting unit, an area type determining unit. 
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and an image quality enhancing unit. The history infonmation updating unit updates history 
information regarding color data and a pixel type of a concerned pixel using previous history 
information of the concemed pixel. The block feature type detecting unit determines a block 
feature type of the concerned pixel using the pixel type and the updated history information 
of the concerned pixel. The area type detemnining unit detemiines a type of an area to 
which the concerned pixel belongs depending on a second type of a second area to which a 
first neighboring pixel in a left direction of the concerned pixel belongs, the pixel type of the 
concerned pixel, a third type of a third area to which a second neighboring pixel in a line 
above the concerned pixel belongs, and the block feature type of the concerned pixel 
provided by the block feature type detecting unit. The image quality enhancing unit 
enhances an image quality of the concerned pixel to different degrees according to the area 
type determined by the area type determining unit. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 3] The above and other features and advantages of the present invention will 
become more apparent by describing in detail exemplary embodiments thereof with 
reference to the attached drawings in which: 

[0014] FIG 1 is a flowchart illustrating a conventional method of enhancing an image 
quality of a document including a combination of a text and an image; 

[0015] FIG. 2 is a flowchart illustrating a method of enhancing digital image quality 
according to an embodiment of the present invention; 

[0016] FIGS. 3A through 30 are views illustrating a concerned pixel having image and 
background block features in a block feature type detection of FIG 2; 

[0017] FIG 4 is a flowchart illustrating a history infonnation update of FIG 2 in 
accordance with an aspect of the present invention; 

[0018] FIG 5 is a flowchart illustrating a bimodality calculation of FIG 4; 

[0019] FIG 6 is a flowchart illustrating a method of obtaining a connection component 
value to detemiine a halftone pixel in a pixel type determination of FIG 2, in accordance with 
an aspect of the present invention; 

[0020] FIG 7 is a flowchart illustrating a connection component value obtaining method 
depending on binary values of a concerned pixel of FIG 5, in accordance with an aspect of 
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the present invention; 

[0021] FIG. 8 is a view illustrating the connection component value obtaining method 
depending on the binary values of the concerned pixel of FIG 5, in accordance with another 
aspect of the present invention; 

[0022] FIG 9 is view illustrating an area type determination of FIG 2, in accordance with 
an aspect of the present invention; and 

[0023] FIG 1 0 is a block diagram of an apparatus to enhance digital image quality 
according to an aspect of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0024] Reference will now be made in detail to the embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 
reference numerals refer to the like elements throughout. The embodiments are described 
below in order to explain the present invention by referring to the figures. 

[0025] FIG 2 is a flowchart illustrating a method of enhancing digital image quality 
according to an aspect of the present invention. The method includes: selecting a pixel as a 
concerned pixel of an image at operation 410; converting color data of the concerned pixel 
210; updating history information according to a pixel type of the concerned pixel 220; 
determining a block feature type of the concerned pixel 230; determining a type of an area to 
which the concerned pixel belongs 240; and enhancing image quality of each area 250; and 
performing a final pixel determination operation 460. 

[0026] Referring to FIG. 2, in the pixel selecting operation 410, pixel selection is 
performed starting from a first pixel. Thus, in an initial pixel position value setting operation 
411 , an initial pixel position value I is set to be zero. In an initial position value increasing 
operation 412, the initial pixel position value I increases by 1, Then, in the color data 
conversion 210, RGB color data of the concerned pixel is converted into color data having 
brightness, saturation, and color components. Here, a YIQ color model, an YCbCr color 
model, or the like is used. 

[0027] In the YIQ color model, Y denotes a brightness component, and I and 0 denote 
color components. If R, G, and B values are given, Y, I, and Q values can be expressed by 
Equation 1 below: 
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10028] Y = 0.29900R + 0.58700G + 0.11400B 
I = 0.59600R - 0.27500G - 0.321 GOB 

Q = 0.21200R - 0.52300G + 0.31100B ...(1) 

[0029] If the RGB color data is converted using the YIQ color model, it is possible that 
the brightness component be adopted as the Y component, and a saturation component be 
obtained from a sum of absolute values of I and Q components or a root mean square 

(RMS) of the I and Q components. A color component can be obtained by arctan — . 

[0030] in the YCbCr color model, Y represents brightness, and Cb and Cr represent blue 
saturation and red saturation, respectively. If R, G, and B values are given. Y. Cb. and Cr 
values can be expressed by Equation 2: 

[0031] Y = 0.29900R + 0,58700G + 0,11400B 

Cb ='0.16874R-0.33126G + 0.50000B 

Cr = 0.50000R - 0.41869G - 0.08131B ...(2) 

[0032] If RGB color data is converted using the YCbCr color model, it is possible that the 
brightness component be adopted as the Y component, and the color component be 
obtained from a sum of absolute values of Cb and Cr components or an RMS of the Cb and 

Cb 

Cr components. The color component can be obtained by arctan — . 

[0033] The history infonnation update operation 220 includes a pixel pre-processing 
operation 221 , a pixel type determination operation 222, and a first and second history 
infonnation update/storage operation 223. Here, the pixel pre-processing operation 221 is 
optional. In this case, the color data provided from the color data conversion of operation 
210 is provided to the pixel type detemnination 222. 

[0034] In the pixel pre-processing operation 221 , the concerned pixel is low-pass filtered 
or non-processed and then output according to the magnitude of a bimodality value of the 
concerned pixel. 

[0035] In the pixel type determination operation 222, the brightness component and the 
saturation component of each low-pass filtered or non-processed concerned pixel in a 
current line are compared with a brightness threshold and a saturation threshold, 
respectively. Then, whether the concerned pixel is a background pixel or an image pixel is 



6 



Docket No.: 101-1001 



determined based on the comparison result. If the saturation component of the concerned 
pixel is smaller than a saturation threshold SO and the brightness component is greater than 
a high brightness threshold B1, the concerned pixel is classified as the background pixel. 
Pixels that do not satisfy the requirements of the background pixel become non-background 
pixels. If the concerned pixel is a non-background pixel and the saturation component of the 
concerned pixel is greater than the saturation threshold SO or the brightness component is 
greater than a low brightness threshold B2, the concerned pixel is classified as the image 
pixel. Here, the saturation threshold SO is, for example, 15, the high brightness threshold B1 
is, for example, 250 close to white, and the low brightness threshold 82 is, for example, 100 
close to black. 

[0036] In order to determine whether the concerned pixel is a halftone pixel, it is 
determined whether a four-direction connection component value of pixels in a 3 x N 
window, e.g., a 3 x 3 window, around the concerned pixel is a predetermined value, 
preferably 2 or more. If the four-direction connection component value is 2 or more, it is 
determined whether a difference between a maximum value and a minimum value of 
brightness components of the pixels in the 3 x 3 window is greater than a brightness 
difference threshold, preferably 30 or more. 

[0037] In the first and second history information update/storage operation 223, first or 
second history infonnation of the concerned pixel is updated and stored based on the 
determination result in the pixel type determination operation 222. Here, the first history 
information has a value representing how many successive background pixels exist above 
the concerned pixel in order to determine a background block feature type, and the second 
history information has a value representing how many successive image pixels exist above 
the concerned pixel to determine an image block feature type. 

[0038] If the concerned pixel is classified as the background pixel in the pixel type 
determination operation 222, the number of the successive background pixels above the 
concerned pixel and the concerned pixel are stored as the first history information regarding 
the concerned pixel. Preferably, if the number of the successive background pixels above 
the concerned pixel is a predetermined number of m or more, the number m is stored as the 
first history information of the concerned pixel. If the number of successive background 
pixels above the concerned pixel is the number m or less, a corresponding number is stored 
as the first history infomnation of the concerned pixel. Preferably, at a resolution of 600 dots 
per inch (dpi), m can be set to be 3. In this case, a memory may be used to store the 
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background pixel used as the first history information in a unit of [log2m + 1] bits where [ ] 
denotes a Gauss symbol (the resulting integer value (function) not exceeding the integer 
value inside the bracket (maximum value). If m is 3, the background pixel requires 2 bits. 

[0039] If the concerned pixel is classified as the image pixel in the pixel type 
determination operation 222, the number of the successive image pixels above the 
concerned pixel is stored as the second history information regarding the concerned pixel. 
Preferably, if the number of the image pixels above the concemed pixel and the concerned 
pixel is a predetermined number of p or more, the number p is stored as the second history 
information of the concemed pixel. If the number of image pixels above the concerned pixel 
is the number p or less, a conresponding number is stored as the second history information 
regarding the concerned pixel. Preferably, at the resolution of 600dpi, p can be set to be 7. 
In this case, a second memory may be used to store the image pixel as the second history 
information in a unit of [log2p+1] bits. If p is 7, the image pixel requires 3 bits. 

[0040] Accordingly, a gross memory may be used to store first and second history 
information regarding each pixel in one line (the number of pixels per one line x 5 bits), thus 
considerably reducing cost for realizing hardware. 

[0041] In the block feature type detection operation 230, the background block feature 
type and the image block feature type are detected using the first or second history 
infomiation. The background block feature type is detected with reference to the first history 
infomiation when m stored background pixels successively appear a number of n or more 
times in a left direction of the concerned pixel and/or in a right direction from a pixel of a 
previous line neighboring a concerned line, including the concemed pixel that is the 
background pixel, as shown in FIG 3A. Preferably, at the resolution of 600dpi, m and n can 
be set to be 3 and 5, respectively. The image block feature type is detected with reference 
to the second history information when p stored image pixels successively appear a number 
of q or more times in a left direction of the concerned pixel and/or in a right direction from a 
pixel of a previous line adjacent to a concemed line, including the concemed pixel that is an 
image pixel, as shown in FIG. 3B. Preferably, at the resolution of 600dpi, p and q can be set 
to be 7 and 20, respectively. As shown in FIG. 3C, the image block feature type can also be 
detected when the non-background pixels successively appear a number of r or more times 
in the left direction of the concerned pixel, including the concerned pixel that is the image 
pixel. Preferably, at the resolution of 600dpi, r can be set to be 200. 

[0042] A halftone block feature type is detected when the concerned pixel is a halftone 
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pixel, and the concerned pixel and the halftone pixel exist within a range of a standard 
halftone distance in the left direction, preferably within a halftone range of 11, or a pixel of an 
upper line adjacent to the concerned pixel belongs to a halftone image area. 

[0043] In the area type determination operation 240, a type of an area to which the 
concerned pixel belongs is determined based on a second area to which a previous pixel on 
the left side of the concerned pixel belongs, a third area to which a pixel adjacent to a 
concerned pixel in a previous line belongs, the pixel type in the pixel type determination 
operation 222, and the block feature type in the block feature type detection operation 230. 

[0044] In the image quality enhancement operation 250, when the type of the area to 
which the concerned pixel belongs is determined in the area type determination operation 
240, an image quality of each area is enhanced to different degrees. Here, unsharpened 
masking can be used as an emphasis technique used during the image quality enhancement 
operation 250. According to the unsharpened masking, brightness of a pixel to be 
emphasized is obtained by Equation 3: 

[0045] Le = L5 + k(L5 - Lavg) ... (3) 

[0046] In Equation 3 above, L5 denotes the original brightness of the pixel to be 
emphasized, Lavg denotes an average value of the brightness in a set window, Le denotes 
an emphasized brightness value, and k is an emphasis coefficient. 

[0047] If the concerned pixel is classified as a text area, the brightness of the concerned 
pixel is classified into high, middle, and low bright classes, i.e., three brightness classes, in 
order to maximize a difference between the text area and an image area. Next, if the 
brightness of the concerned pixel belongs to the high brightness class, when a color image 
with 256 scale is output, each of R, G, and B is set to 255 to fill the concerned pixel with a 
white color, if the brightness of the concerned pixel belongs to the low brightness class, 
each of R, G, and B is set to zero to fill the concerned pixel with a black color. If the 
brightness of the concerned pixel belongs to the middle brightness class that mostly appears 
at the boundary between the text area and the image area, the unsharpened masking is 
performed to emphasize the boundary of the text area. The emphasis coefficient used 
during the unsharpened masking can be calculated using a mean brightness of 3 x 3 pixels 
neighboring the concerned pixel. Preferably, the mean brightness and the emphasis 
coefficient vary in a straight line that connects a pixel (100, 6) and a pixel (250, 1). If the 
concerned pixel is classified into a background area, an original image is output. 
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[0048] If the concerned pixel is classified into a continuous tone image area, the 
unsharpened masking is performed to emphasize the boundary of the continuous tone 
image area. The emphasis coefficient used during the unsharpened masking can be 
calculated using the mean brightness of the 3 x 3 pixels neighboring the concerned pixel. 
Preferably, the mean brightness and the emphasis coefficient vary in a straight line that 
connects a pixel (0, 6) and a pixel (255, 1). 

[0049] If the concerned pixel is classified into a halftone image area, the original image is 
output, a LPF is used to prevent the appearance of a pattern unpleasant to viewer's eyes, or 
the unsharpened masking using a very small emphasis coefficient, preferably 1 or less, is 
employed. 

[0050] FIG 4 is a flowchart illustrating an aspect of the history information update 
operation 220 of FIG 2. The history information update operation 220 includes a pixel pre- 
processing operation 420, a pixel type determination 430, a first history information update 
440, and a second history information update operation 450. Here, the pixel pre-processing 
operation 420 is optional. 

[0051] Refening to FIG 4, in a bimodality calculation operation 421 of the pixel pre- 
processing operation 420, a bimodality of pixels in a 3 x N window (where N is 3 or more), 
e.g., a 3 X 3 window, around the concerned pixel are calculated. In a bimodality magnitude 
comparison operation 422, the bimodality in the bimodality calculation operation 21 is 
compared with a predetermined bimodality threshold, and then it is determined whether the 
bimodality is greater than the predetermined bimodality threshold. Here, the predetermined 
bimodality threshold is preferably set to be 50. 

[0052] If the bimodality is greater than the predetermined bimodality threshold in the 
bimodality magnitude comparison operation 422, the concerned pixel is not additionally 
processed, and then a pixel type detemriination operation 430 is performed. If the bimodality 
is less than the predetermined bimodality threshold, the concerned pixel is low-pass filtered 
in a concerned pixel low-pass filtering operation 423, and then the pixel type determination 
operation 430 is performed. Here, the bimodality greater than the predetermined bimodality 
threshold indicates that the concerned pixel is a pixel positioned around the boundary of the 
text area or belonging to the halftone image area. The bimodality less than the 
predetenmined bimodality threshold indicates that the concerned pixel is a pixel belonging to 
the background area or the continuous tone image area. 



10 



Docket No.: 101-1001 



[0053] In an I pixel type determination operation 431 of the pixel type determination 
operation 430, it is determined whether the saturation component of the 1^^ pixel is smaller 
than the saturation threshold SO and the brightness component of the 1^^ pixel is greater than 
the high brightness threshold B1 . If the saturation component of the 1^^ pixel is smaller than 
the saturation threshold SO and the brightness component is greater than the high 
brightness threshold B1 , the 1^*" pixel is detennined as the background pixel. If the 1*^ pixel is 
determined as the non-background pixel in the 1*^ pixel type determination operation 431 , it 
is determined whether the 1**^ pixel is the image pixel in an 1*^ pixel type determination 432. 
Here, if the saturation component of the 1*^ pixel is greater than the saturation threshold SO 
or the brightness component is greater than the low brightness threshold B2 and smaller 
than the high brightness threshold 81, the 1^ pixel is classified as the image pixel. 

[0054] If the 1*^ pixel is determined as the background pixel in the 1^^ pixel type 
determination operation 431. in an 1*^ pixel image history setting operation 441 of the first 
history infomnation update operation 440, an image history of the 1^ pixel is set to be zero. In 
a background history magnitude detemiination operation 442, it is detenriined whether an 
already-stored background history is less than a predetermined number m, e.g., 3. If the 
background history is equal to or greater than the number m in the background history 
magnitude determination operation 442, the background history is maintained at the number 
m. If the background history is less than the number m, the background history increases by 
1. 

[0055] If the 1^^ pixel is neither the background pixel nor the image pixel in the 1^^ pixel type 
determination operation 432, in an 1^^ pixel background history setting operation 451 of the 
second history infomiation update operation 450, a background history of the 1^ pixel is set 
to be zero. If the I**" pixel is determined as the image pixel in the 1*^ pixel type determination 
operation 432, in an 1*^ pixel background history setting operation 452, the background 
history of the 1*^ pixel is set to be zero. In an image history magnitude determination 
operation 453, whether an already-stored image history is less than a predetermined number 
p, e.g., 7, is determined. If the image history is equal to or greater than the number p, the 
background history is maintained at the number p. If the image history is less than the 
number p, the image history increases by 1 . 

[0056] A method of calculating the bimodality in the bimodality calculation operation 421 
of the pixel pre-processing operation 420 of FIG. 4 will be described with reference to FIG. 5. 

[0057] Referring to FIG 5, the bimodality calculating method includes a window setting 
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operation 511 , a mean brightness component calculation operation 513, a grouping 
operation 515, and bimodaiity determination operations 517 and 519. 

[0058] In the window setting operation 511 , the 3 x 3 window is set around the concerned 
pixel. In the mean brightness component calculation operation 513, a mean of brightness 
components of ail pixels in the 3 x 3 window is calculated. 

[0059] In the grouping operation 515, the mean in the mean brightness component 
calculation operation 513 is compared with each of the brightness components of all the 
pixels in the 3 x 3 window to group the pixels into a first pixel group having a higher 
brightness component than the mean and a second pixel group having a lower brightness 
component than the mean. 

[0060] In the bimodaiity determination operation 517, a first sub-mean of brightness 
components of pixels belonging to the first pixel group and a second sub-mean of brightness 
components of pixels belonging to the second pixel group are calculated. In the bimodaiity 
determination operation 519. a difference between the first and second sub-means of the 
brightness components of the first and second pixel groups in the bimodaiity determination 
operation 517 is calculated to determine the difference as the bimodaiity of a corresponding 
concerned pixel. 

[0061] A method of calculating a connection component value CC of the pixels in the 3 x 
3 window in order to detemnine the halftone pixel in the pixel type determination operation 
221 of FIG. 2 will be described with reference to FIGS. 6 through 8. 

[0062] Referring to FIG. 6, the connection component value calculating method includes a 
window setting operation 611 , a mean brightness component calculation operation 61 3, a 
binarization operation 615, and a connection component value determination operation 617. 

[0063] In the window setting operation 61 1 , the 3 x 3 window is set around the concerned 
pixel. In operation 613, a mean of brightness components of all pixels in the 3 x 3 window is 
calculated. 

[0064] In the binarization operation 615, another mean in the mean brightness component 
calculation operation 613 is compared with each of the brightness components of all the 
pixels in the 3 x 3 window, and then "1" or "0" is allocated to each of the brightness 
components based on the comparison result to perfomi binarization. For example, if a 
brightness component of a corresponding pixel is less than the another mean, "1" is 
allocated to the corresponding brightness component, while if the brightness component of 
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the corresponding pixel is greater than the another mean, "0" is allocated to the 
corresponding brightness component. 

[0065] In the connection component value determination operation 617, the connection 
component value CC is determined according to different calculation methods based on 
binary values of the concerned pixel by using a logic circuit instead of a lookup table in order 
to minimize an amount (capacity) of a required memory. This will be explained in more detail 
with reference to FIGS. 7 and 8. 

[0066] Referring to FIG. 7, in a binary value determination operation 711 . whether a binary 
value of the concerned pixel, i.e., a pixel B5, is "1" is determined. 

[0067] If the binary value of the concerned pixel is "0" in the binary value determination 
operation 711, the number of successive blocks having binary values of "0" and "1" that 
successively appear starting from a pixel B1 along a clockwise direction 80 is counted to 
detemnine the number of successive blocks as the connection component value CC in a 
connection component value determination operation 712. For example, as shown in FIG 8, 
if pixels B1, B3, B4, and B8 including a pixel B5 that is a concerned pixel have values of "0", 
the connection component value CC becomes 3. 

[0068] If the binary value of the pixel B5 is "1" in the binary value determination operation 
711 , a sum of binary values of pixels B2, B4, B6, and B8 is defined as a connection degree, 
and then the connection component value CC is determined according to different methods 
based on the connection degree in a connection degree definition operation 71 3. If the 
connection degree has the binary value of "0,", , a value obtained by adding "1" to a sum of 
binary values of pixels B1 , B3, B7 and B9 is determined as the connection component value 
CC in a connection component determination operation 715. If the connected degree has a 
non-zero value in the binary connection degree value determination operation 714, it is 
determined whether the connection degree has a value of "1" in a connection degree 
determination operation 716. If the connection degree has the value of "1 the number of 
values of "1" that successively appear in a clockwise direction 80 is counted in a connection 
component value determination operation 71 7 to determine the number of values of "1 " as 
the connection component value CC. 

[0069] If the connection degree does not have the value of "1 " in the connection degree 
determination operation 716, it is determined whether the connection degree has a value of 
"3" or "4" in a connection degree determination operation 718. If the connection degree has 
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the value of "3" or "4," the cx)nnection component value CC is then deternnined to be 1 in a 
connection component value detemiination operation 719. if the connection degree has a 
value of "2" in the connection degree determination 718, then it is determined whether the 
pixels B2 and B8 each have a binary value of "1" or the pixels B4 and 86 each have a binary 
value of "1" in a binary value determination operation 720. If the pixels 82 and 88 each have 
the binary value of T or the pixels 84 and 86 each have the binary value of "1 / the 
connection component value CC is determined to be 1 in a connection component 
determination operation 721. 

[0070] If the pixel 82 or 88 does not have the binary value of "1" and the pixel 84 or 86 
does not have the binary value of "V in the binary value determination operation 720, then it 
is determined whether the pixel 82 has a binary value of "1" in the binary value 
determination operation 722. If the pixel 82 has the binary value of "1 then it is determined 
whether the pixel 84 has a binary value of "1" in a binary determination operation 723. If the 
pixel 84 has the binary value of "1 the connection component value CC is deternnined in a 
connection component detemiination operation 721 as a value obtained by adding "1" to a 
binary value of the pixel 89. If the pixel 84 does not have the binary value of "1" in the 
binary value determination 723, the connection component value CC is then determined in a 
connection component value determination operation 725 as a value obtained by adding "1" 
to a binary value of the pixel 87. 

[0071] If the pixel 82 does not have the binary value of "1 " in the binary value 
determination operation 722, then it is determined whether the pixel 84 has a binary value of 
"1" in the binary value determination operation 726. If the pixel 84 has the binary value of 
"1 ," the connection component value CC is determined as a value obtained by adding "1" to 
a binary value of the pixel 83 in a connection component value determination operation 727. 
If the pixel 84 does not have the binary value "1" in the binary value determination operation 
726, the connection component value CC is then detemiined as a value obtained by adding 
"1" to a binary value of the pixel 81 in a connection component value determination 
operation 728. 

[0072] FIG 9 illustrates an aspect of the area type determination operation 240 of FIG 2. 
Prior to the explanation of the area type determination operation 240, an image mark 
memory usable to determine the continuous tone image area in area type determination 
operation 240 will be described. 

[0073] The image mark memory is a line memory having a width of 1 bit in which when 
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the concerned pixel is classified into the continuous tone image area due to the detection of 
the image block feature type, a position next to a position in which the background block 
feature type is finally detected on the left side of the concerned pixel is set to be 1 . As a 
result, the continuous tone area can be segmented starting from a position in a next line in 
which the image mark memory is set to be 1 . 

[0074] Referring to FIG. 9, if a prevbus pixel belongs to the background area in a state 
911 and the concerned pixel is the non-background pixel in a state 913, the concerned pixel 
is classified into the text area. If the concerned pixel is the background pixel in a state 912, 
the concerned pixel remains belonging to the background area. When the image mark 
memory is used, the previous pixel belongs to the background area in the state 911 . and the 
image mark memory is set to be 1 in a state 921 , the concerned pixel is classified into a 
continuous tone image area. 

[0075] If the previous pixel belongs to the text area in a state 914 and the background 
block feature type is detected from the concerned pixel in a state 916, the concerned pixel is 
classified into the background area. If the image block feature type is detected from the 
concerned pixel or the image mark memory is set to be 1 in a state 917, the concerned pixel 
is classified into the continuous tone image area. Even if a pixel of an upper line adjacent to 
the concerned pixel belongs to the continuous tone image area or the halftone image area in 
a state 917, the concerned pixel is classified into the continuous tone image area. If the 
concerned pixel does not satisfy these requirements in a state 915, the concerned pixel 
remains belonging to the text area. 

[0076] If the previous pixel belongs to the continuous tone image area in a state 91 8 and 
the background block feature type is detected from the concerned pixel in a state 920, the 
concerned pixel is classified into the background area. If the halftone block feature type is 
detected from the concerned pixel in a state 922, the concerned pixel is classified into the 
halftone image area. If the concerned pixel does not meet these requirements in a state 
919, the concerned pixel remains belonging to the continuous tone image area. 

[0077] If the previous pixel belongs to the halftone image area in a state 923 and the 
concerned pixel satisfies one of two requirements for determining halftone pixels, i.e., a four- 
direction connection component value should be 2 or more and a difference between a 
maximum value and a minimum value of the brightness components of the pixels in the 3 x 3 
window around the concerned pixel should be greater than a brightness difference threshold, 
the concerned pixel is then classified into the halftone image area in a state 924. If the 
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concerned pixel does not meet both of two requirements stated above, the concerned pixel 
is then classified into the continuous tone image area in a state 925. 

[0078] FIG. 10 is a block diagram of a digital image quality enhancing apparatus 
according to an aspect of the present invention. The digital image quality enhancing 
apparatus includes a pixel input unit 1011 , a history infomiation updating unit 1012, a 
background block feature detecting unit 1015. an image block feature detecting unit 1014, a 
halftone block feature detecting unit 1015, an upper line information storing unit 1016, an 
area type determining unit 1017, an image quality enhancing unit 1019, and a storing unit 
1020. Here, the storing unit 1020 is optional in the digital image quality enhancing 
apparatus. 

[0079] The pixel input unit 1011 inputs the color data of the pixels, which have been 
converted into YIQ or YCrCb color spaces, and then obtains brightness, saturation, and color 
components from the color data of the concerned pixel, on a pixel-by-pixel basis. 

[0080] The history information updating unit 1012 updates the history information 
depending the type of the concerned pixel provided by the pixel input unit 1011 using 
previous history information of the concerned pixel. For this, the concerned pixel is low-pass 
filtered or non-processed according to the magnitude of the bimodality of the concerned pixel 
and then output. Next, the brightness component and the saturation component of each 
concerned pixel in the current line output after being low-pass filtered or non-processed are 
compared with the brightness threshold and the saturation threshold, respectively. 
Thereafter, whether each concerned pixel is the background pixel or the image pixel is 
determined based on the comparison result. 

[0081] If a first number of m stored pixels, from which the background block feature type 
is to be detected, successively appear by a second number of n pixels, from which the 
background block feature type is to be detected, in the left direction of the concerned pixel, 
the background block feature detecting unit 1013 classifies the concerned pixel as a pixel 
having the background block feature type with reference to the history information. Here, m 
and n may be 3 and 5, respectively. 

[0082] If a first number of p stored pixels, from which the image block feature type is to be 
detected, successively appear by a second number of q pixels, from which the image block 
feature is to be detected, in the left direction of the concerned pixel, the image block feature 
detecting unit 1014 classifies the concerned pixel as a pixel having the image block feature 
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type with reference to the history information. Here, p and q may be 7 and 20, respectively. 

[0083] The halftone block feature detecting unit 1015 classifies the concerned pixel as a 
pixel having the halftone block feature type using the pixel type of the concerned pixel, pixel 
types of pixels in the left side of the concerned pixel, and types of areas to which pixels 
upwardly neighboring the concerned pixel belong. 

[0084] The upper line area information storing unit 1016 stores information on types of 
areas to which neighboring pixels in a line above the concerned pixel belong. 

[0085] The storing unit 1 020 is the image mark memory having line memories having a 
width of 1 bit in which when the image block feature detecting unit 1014 detects the image 
block feature type from the concerned pixel, a position next to a position, from which the 
background block feature type is finally detected, in the left side of the concerned pixel is set 
tobe1. 

[0086] The area type determining unit 1017 detemiines the type of an area to which the 
concerned pixel belongs based on a second type of a second area to which a first 
neighboring pixel in the left side of the concerned pixel recorded in an internal memory (not 
shown) 1018, the pixel type of the concerned pixel provided from the history information 
updating unit 1012, a second type of a second neighboring pixel in a line above the 
concerned pixel that is provided from the upper line area information storing unit 1016, the 
types of the background, image, and halftone block feature types provided from the 
background, image, and halftone block feature detecting units 1013, 1014, and 1015, and 
the information stored in the image mark memory of the storing unit 1020. 

[0087] The image quality enhancing unit 1019 enhances an image quality of the 
concerned pixel to different degrees depending on the area type determined by the area 
type determining unit 1017. 

[0088] As described above, according to the present invention, a document image 
obtained by scanning a document including a combination of a text and an image can be 
segmented into a text area, a background area, a halftone image area, and a continuous 
tone image area. Next, an image quality enhancing process suitable for each of the text 
area, the background area, the halftone image area, and the continuous tone image area 
can be perfontied to obtain a considerably improved image quality print. 

[0089] In addition, first and second history information can be used to detect background 
and image block features and a logic circuit can be used to determine a connection 
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component value. As a result, the amount (capacity) of the required memory can be 
minimized, which results in a considerable reduction in cost for realizing hardware. 

[0090] Moreover, when the first and second history infomiation is updated, the bimodallty 
of the concerned pixel is compared with the predetermined threshold, and then whether pre- 
processing, such as low-pass filtering or the like, is perfonned is detemiined based on the 
comparison result. Thus, the accurate segmentation of the text area and the halftone image 
area can be achieved. Also, a reduction in the amount of infomriation used to detect the 
halftone block feature type can reduce an amount of a line memory. 

[0091] The above-described embodiments of the present invention can be written as 
programs which can be executed in a computer and can be realized in a general-purpose 
digital computer, which executes the programs, using computer-readable recording media. 
Computer-readable recording media include magnetic storage media such as ROMs, floppy 
discs, hard discs or the like, optical reading media such as CD-ROMs, DVDs, or the like, and 
storage media using carrier waves transmitted via the Internet. 

[0092] Although a few embodiments of the present invention have been shown and 
described, it will be appreciated by those skilled in the art that changes may be made in 
these embodiments without departing from the principles and spirit of the invention, the 
scope of which is defined in the appended claims and their equivalents. 



18 



